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I— I. Abstract 

i—{ ' In this paper, we investigate achievable rates on the multiple access channel 

^ • with feedback and correlated sources (MACFCS). The motivation for studying the 

I— — i! MACFCS stems from the fact that in a sensor network, sensors collect and transmit 

^^ I correlated data to a common sink. We derive two achievable rate regions for the 

> ■ three-node MACFCS. 

oo : 

§ ■ 1 Introduction 

o: 

pP I We consider a sensor network in which every sensor is capable of transmitting as well as 

■~>^ ' receiving. Each sensor collects data and aims to send them to a single destination. We 

O ■ note that the data collected by the sensor nodes might be correlated, e.g., if they are 

>■ ! located close to one another. Taking into account these facts, we model the two-sensor 

'^ I single-sink network by the channel depicted in Fig. ^ We term this channel the multiple 

?-j I access channel with feedback and correlated sources (MACFCS). 

This channel is a combination of the multiple access channel with correlated sources 
(MACCS) and the multiple access channel with feedback (MACF). The MACCS (with a 
common part) was studied by Slepian and Wolf P, who derived an achievable rate region. 
In their paper, separate source coding and channel coding are used, where source coding 
is first performed to remove the correlation between the two sources and then channel 
coding for the multiple access channel (MAC) with independent sources is employed. The 
MACCS (with possibly no common part) was considered by Cover et al. j2]. They showed, 
by using a simple example, that separating source and channel coding is not optimal and 
derived an achievable rate region for the MACCS. 

The MACF (with independent sources) was investigated by Cover and Leung [Hj. In 
their model, there are two sources and all nodes, i.e., the two sources and the destination, 
receive the same channel output. A year later, Carleial [4 further generalized the channel 
to the case where each node receives a different channel output signal. 
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Figure 1: The three-node multiple access channel with feedback and correlated sources. 

The three-node discrete memoryless MACFCS is denoted by (iSi x iS2,p(si, S2), ^"1 x 
'^2,P*{yi,y2,y3\xi,X2),yi x 3^2 x 3^3)- si G Si and S2 G S2 are the source messages to node 
1 and 2 respectively and they are drawn from the discrete bivariate distribution p{si, 82)- 
Here, Si, S2, Xi, X2,yi,y2, and 3^3 are seven finite sets. p*{yi,y2,y3\xi,X2) defines the 
channel transition probability on 3^i x 3^2 x 3^3 for each (a;i,X2) E Xi x X2. Xi and X2 are 
the inputs to the channel from nodes 1 and 2 respectively, j/i, 2/2, and 2/3 are the channel 
outputs to nodes 1, 2, and the destination respectively. We say that (si, S2) can be reliably 
transmitted to the destination if the probability that the destination wrongly decodes a 
pair of (si, S2) G 5" x iS^ in each n channel uses can be made arbitrarily small, for large n. 

To the best of our knowledge, only Murugan et al. |E] have considered such a channel. 
However, they only considered Gaussian channels. Their approach is based on joint source- 
channel coding using time division multiple access (TDMA). Our work differs from 13] in 
that arbitrary channels (not only Gaussian channels) are considered. In addition, we 
consider the case where the source nodes can transmit and receive at the same time, 
meaning we do not restrict the transmission scheme to TDMA. 

We classify coding strategies for the MACFCS into two categories. We now describe 
these strategies in more detail. 



1.1 Full Decoding at Sources 

For full decoding at sources, the general idea is for the sources to communicate so that 
each source has full information about what the other sources have. They then cooperate 
to send the combined signal to the destination. A scheme was proposed in 0, where the 
transmissions are split into two phases. In the first phase, the source nodes communicate 
with each other using TDMA. At the end of the first phase, each source has full information 
of what all other sources have. In the second phase, all sources cooperate to transmit to 
the destination. In this paper we offer an alternative solution (see Section 12)) for full 
decoding at sources. Each source node transmits cooperative information of the previous 
block (which it decodes from other nodes) and new information (which is to be decoded by 



other sources and the destination) simultaneously. Since all nodes agree on the same fully 
decoded information of the previous block, coherent combining can be achieved. Under 
certain channel conditions, that all nodes fully decode the information of all other nodes 
might not be desirable. One example is when node 1 is far from the destination and node 
2 is near to the destination. In this case, it is not necessary for node 1 to decode node 2's 
information. This leads us to the second strategy, in which full decoding is only done at 
the destination. 

1.2 Full Decoding at Destination 

For full decoding at the destination, source coding is first performed at every source node. 
This does not require physical communication among the sources. From P, each source 
node performs source coding and forms independent inputs to the channel encoder. This 
removes the correlation between the sources. 

At this point, we have turned the problem into channel coding for the MACF with 
independent sources. An achievable region of the MACF was obtained by Carleial jl]. We 
call that the partial decode-forward strategy. In this paper, we find another achievable 
region for the MACF using the compress-forward strategy (see Section r3.3|) . Combining 
the rate constraints of the source coding (for correlated sources) and the channel coding 
(for the MACF), we arrive at other achievable rate regions for the MACFCS. To the best 
of our knowledge, the compress- forward strategy has not been studied on the MACF. 

2 Full Decoding at Sources 

In this strategy, every node decodes the information from all other nodes and they cooper- 
ate to send information to the destination. We note that for the nodes to cooperate, they 
must first agree on the messages. In order to do this, they must first decode transmissions 
from the other nodes. We consider the following correlation structure in which the sources 
have a common part to send. ^ Let D, E, and F be three independent random variables, 
equi-probable in {1,2, ... ,d} = "D, {1, 2, . . . , e} = £, and {1,2,...,/} = J^ respectively. 
Node 1 receives ^i = {D, E) eV x S and node 2 receives 5*2 = {D, F) eV x J^. 

We note that node 1 does not know F and node 2 does not know E. The idea here is 
for node 1 to decode F (from node 2's transmission) and for node 2 to decode E. After 
decoding, both nodes have the full information [D, E, F). They cooperate to send the fully 
decoded information as well as new information that is unknown to and to be decoded by 
other nodes. In summary, node 1 sends {E,D',E',F') and node 2 sends {F, D', E', F'), 
where prime denotes the previous block's information. 



"'^We assumed here that sources have a common part to send for the purpose of iUustration only. The 
analysis in this section applies equally well to arbitrarily correlated sources. 



2.1 An Achievable Rate Region 

Theorem 1 Let (Si x S2,p{si, S2), Xi x X2,P*iyi, 2/2, ysla^i, ^2), 3^i x 3^2 x y^) be a discrete 
memoryless three-node MACFCS. (si,S2) can be reliably transmitted to the destination if 
the following holds. 

H{S,\S2) <mm[I{Xi;Y2\Wo,Wi,W2,X2),I{Wi-,Ys\Wo,W2) + I{Xi;Y3\Wo,Wi,W2,X2)] 

(la) 

H{S2\Si) < mm[I{X2; Yi\Wo, W^ W2, Xi), /(IV2; F3I W^o, Wi) + J(X2; ^31^0, W,, W2, X^)] 

(lb) 

IiSv,S2)<IiWo;Ys\W^,W2), (Ic) 

H{Si) < I{Wo, Wi; Ys\W2) + /(Xi; Ys\Wo, Wi, W2, X2), (Id) 

H{S2) < IiWo,W2;Y,\W^) + IiX2;Y,\Wo,WuW2,X,), (le) 

H{S,\S2) + H{S2\S^) < liWu W2; Ys\Wo) + I{X^, X2; Y^\W^, Wu W2). (If) 

H{S^,S2)<I{X^,X2,Y^), (Ig) 

where p{Xi,X2,yi,y2,y3,U)o,Wi,W2) = p{Wo)piWi)p{w2)piXi\Wo,Wi,W2)p{x2\Wo,Wi,W2) X 

P*{yi,y2,y3\xi,X2,X3). Wo, Wi andW2 are auxiliary random variables. 
In the next section, we give a brief outhne of the proof for Theorem ^ 

2.2 Encoding and Decoding 

First, we describe the coding scheme. Using Slepian and Wolf's Theorem 2 in [Hj, we know 
that when node 1 only knows 5"! = {D,E) and node 2 knows S2 = {D,F), node 1 can 
encode E using if(5'i|S'2) bits and it can decoded by node 2. Similarly, node 2 can use 
H{S2\Si) bits to encode F. The codebook generation is as follows: 

1. Fix the probability mass functions p{wo) , p{wi) , p{w2) , p{xi\wo, wi, W2) , and 

p{x2\Wo,Wi,W2). 

2. Generate 2"[^('^i''^2)+e] i_i_(j_ sequences wq according to Y[i=i p(^oj)- Index them wo(z), 
zg{1,2,...,2"[^(^1'^^)+^]}. 

3. Generate 2"[-'^('^il'^2)+e] i_i,^_ sequences wi according to YY^=iPi^ii)- Index them 
Wi(j),JG{1,2,...,2"[^(^^I^^)+^1}. 

4. Generate 2"[-'^('^2|S'i)+e] [[^ sequences W2 according to Y[i=iPi^2i)- Index them 
W2(A;), ke {l,2,...,2"[^(^^l^i)+^]}. 

5. Define h' = {i',j',k'). For each (wo(i'), wi(j'), W2(A;')), generate 2"I-f^(^i'^2)+'] se- 
quences xi according to ]J^^iP{xii\woi{i'),Wii{j'),W2i{k')). 

Index them xi(j, h'), j G (l, 2, . . . , 2"[^(^il^2)+.] j_ 
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Figure 2: Coding for the multiple access channel with feedback and correlated sources 
using the decode-forward strategy. 



6. Again for each (wo(i')) wi(j'), W2(/i;')), independently generate 2"[-'^('^2|5'i)+e] sequences 
X2 according to ]J^=iP{x2i\woi{i'),Wu{j'),W2iik')). 
Index them X2 (A;, /i')> k G {l, 2, . . . , 2"[^(^2|5i)+.]|^ 

The encoding steps (refer to Fig. E)) are as follows: 

1. Assume that node 1 correctly estimates the index k' sent by node 2 in the previ- 
ous block. Using its information of {i',j') from the previous block, it determines 
h' = {i',j',k'). Here, we use prime to indicate the index from the previous block. 
Observing a new block of n input symbols Si G (P x S)"", node 1 selects j to represent 
S"'. It can find a unique j with probability tending to 1 if j is encoded with no less 
than n{H{Si\S2) + e) bits [1]. It then transmits Xi(j, h[). 

2. Similarly, assuming that node 2 correctly decodes j', it determines h' = {i',j',k'). 
It transmits X2(A;,/i2). It can find a unique k with probability tending to 1 if fc is 
encoded with no less than n{H{S2\Si) + e) bits |T]. 

The decoding steps are as follows: 

1. Upon observing the sequence yi, node 1 declares k has been sent by node 2 if there 

exists a unique A; such that (xi(j, /i'), wo(2'), wi(/), W2(A;'),X2(A;, /i'),yi j E Ae- We 

use hat to indicate the estimate. Here, Ae is the set of jointly typical sequences (pg. 
195 in [7 ). We note that node 1 knows h' = {i' ,j' , k'), which is the full information 



from the previous block, and its own information j. It can determine the correct k 
with diminishing error probabihty if 

H{S2\Si) < I{X2;Y,\Wo,W,,W2,X,). (2) 

2. Similarly, observing the sequence y2, node 2 declares j has been sent by node 1 if 
there exists a unique j such that (xi(j, /i'), wo(«'), wi(/), W2(A;')x2(A;, /i'),y2) G Ae- 
Node 2 can determine the correct j with diminishing error probability if 

H{S,\S2) < I{X,;Y2\Wo,W,,W2,X2). (3) 

3. The destination (node 3) decodes {i,j, k) over two blocks. In the first block, assuming 
that it has already correctly decoded h' = {i' ,j', k') from the previous block, it finds 

a set of {j,k) e Ci where (^xi(j, /i'), X2(A:, /i'), wo(2'), wi(j'), W2(A;'),y3J e A- In 

the second block, it then finds another set of (j, A;) G £2 and a unique i where 

( wo(i), wi(j), W2(A;), ys) G A^- It declares {i,j,k) has been sent if there is a unique 

i and a unique pair of (j, /c) in £1 fl £2- This can be done with diminishing error 
probability if 



H{Si\S2) + H{S2\S: 



I{S,;S2)<I{Wo;Y,\Wi,W2), (4a 

H{S,\S2) < IiW,;Ys\Wo,W2) + IiX,;Y3\Wo,WuW2,X2^ ^4W 

H{S2\S,) < I{W2;Ys\Wo,W^) + I{X2;Ys\Wo,W,,W2,X, 
H{Si) < IiWo,W,;Ys\W2) + IiXv,Ys\Wo,W,,W2,X2 
H{S2) < liWo, W2; Ys\Wi) + I{X2, Y^\Wo, M^i, W2, X^) 
'S2\S{) < I{W^,W2MW,) + I{X^.X2,Y,,\Wo,W^,W2) 



H{Si,S2)<I{Xi,X2;Y3 



(4b) 
(4c) 
(4d) 
(4e) 
(4f) 

;^3j. (4g) 

We consider all possible error combinations. Assuming that {i,j,k) were sent, (I4a|l 
guarantees that the Pr(z ^ i,j = j,k = k) < e for any e > 0. (|4bjl guarantees that 
Pr(i = i,j y^ j,k = k) < e, (jlcj) guarantees that Pr(z = i,j = j,k ^ k) < e, (|4d|) 
guarantees that Pr(z j^ i,j ^ j, k = k) < e, (jiej) guarantees that Pr(z ^ i,j = j, k 7^ 
k) < e, (jlj) guarantees that Pr(z = i,j j^ j,k j^ k) < e, and Pg| ) guarantees that 
Pr(i ^ ij ^ j^k^k) < e. 



The total probability of error can be bounded for large n if Q, ©, and Paj) to (5g) 
hold. Hence, we have Theorem Q] 

We note that in our derivation, we use a correlation structure with a common part for 
clearer illustration. However, the analysis can be generalized to the case where there is no 
common part, and hence Theorem^ is applicable to sources with any arbitrary correlation 
structure. 



3 Full Decoding at Destination 

Now, we study the strategy when full decoding only occurs at the decoder. First, source 
coding is performed at each individual source node to remove the correlation among the 
signals at the nodes. Then we apply channel coding for the MACF to transmit information 
from the independent sources to the destination. 

3.1 Source Coding for Correlated Sources 

First, we consider a noiseless channel. With node 1 knowing only Si, node 2 knowing only 
S2, the destination can reconstruct (^1,^2) reliably if node 1 encodes Si with rate Ri and 
node 2 encodes S2 with rate R2 P, where 

Ri>H{S,\S2), (5a) 

R2 > H{S2\Si), (5b) 

Ri + R2>H {81,82). (5c) 

3.2 Combine with Partial Decode- Forward for MACF 

An achievable rate region for the MACFCS can be derived by combining the source coding 
rate constraints ( ()5aj) - (jHcjl in Section ITTI and the channel coding constraints for the MACF 
((3a), (3b), (7a)-(7q) in 4J). We call the strategy used in jlj the partial decode-forward 
strategy. The proof that this rate region is achievable is straightforward. 

3.3 Combine with Compress-Forward for MACF 

In this section, we derive an achievable rate for the MACF using the compress-forward 
strategy. Combining this with the source coding rate constraints in Section ITTl we derive 
another achievable rate region for the MACFCS. 

Using the compress-forward strategy, each node transmits independent information as 
well as a quantized and compressed version of its received signal. Referring to Figure El 
j and k are independent information after source coding. Consider node 1 as an example 
first. From the received signal Yi, it produces a quantized version Yi. It then compresses 
Yi to Ui. In the next block, it sends new information j as well as Ui. We can view this 
as node 1 helping node 2 to send a noisy, quantized, and compressed version of node 2's 
signal, k, without needing to fully decode k. Node 2 does likewise. 

3.3.1 An Achievable Rate Region 

Theorem 2 Let [Si xS2,p{si,S2),Xi x A'2,p*(|/i, ^2, Z/ski, X2), 3^i x 3^2 x 3^3) be a discrete 
memoryless three-node MACFCS. The source symbols (^1,52) can he reliably transmitted 
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Figure 3: Coding for the multiple access channel with feedback (with independent sources) 
using the compress-forward strategy. 



to the destination if 



H{S,\S2)<I{X^■Y2,Y,\U^,X2), 
H{S2\S,)<IiX,■,Y^,Y3\U2,X,), 
H{Si,S2) < I{Xi,X2;Yi,Y2,Ys\Ui,U2) 



(6a) 
(6b) 
(6c) 



where the mutual information is taken over all joint probability mass functions 
p{ui)p{xi\ui)p{u2)p{x2\u2)p{yi\yi,xi)p{y2\y2,X2)p*{yi,y2,y3\xi,X2) suchthatYi andY2 are 
independent, subjected to the following constraints 

I{Ui;Ys\U2) > I{Yi;Yi\Xi) - I{Yi;Ys\Y2,Ui,U2), (7a) 

I{U2; Ys\Ui) > I{Y2; Fsl^s) - /(Fa; Ys\Yi, Ui, U2), (7b) 

/(f/i, U2; Y,) > I{Y,; niXi) + I{Y2; ^21^2) - I{Yi, %■, Fsl^i, U2). (7c) 

Here, Ui,U2,Yi, andY2 are auxiliary random variables. 

In the next section, we give a brief outline of the proof for Theorem |21 

3.3.2 Encoding and Decoding 

Figure IHl shows the information data after source coding. Channel encoder 1 receives 
j G {1,2,..., 2"^i} for every Si = [siiSi2 ■ ■ ■ Si„]. Encoder 2 receives k G {1,2,..., 2^^^} 
for every S2 = [S21S22 ■ ■ ■ S2n]- 



Now, we look at channel coding to ensure that the data bits after source coding can be 
reliably transmitted to the destination. The codebook generation is as follows. 

1. Fixp{ui),p{xi\ui),p{u2),p{x2\u2),p{yi\yi,xi) and p{y2\y2,X2), such that ^(^1,^2) = 

p{yi)p{y2)- 

2. Generate 2"-^i i.i.d. sequences ui according to YYi=i Pi'^u) ■ Index them ui(p'), p' G 
{1, . . . , 2'^-^i}. Generate 2"'^^ i.i.d. sequences U2 according to YYi=i Pi'^'ii) ■ Index 
themu2(g'), q' e {l,...,2"^2}- 

3. For each ui(p'), generate 2^^^ sequences xi according to YTi=iPi^ii\'^iiiP'))- Index 
them xi(j,p'), j G {l, . . . , 2"^i}. For each U2(g'), generate 2"'^'^ sequences X2 ac- 
cording to YYi=i Pi^2i\u2i{q')) ■ Index them X2(A;,g'), k E {l, . . . ,2"-^^}. 

4. For each xi(j, p'), generate 2"^^ sequences yi according to YYi=i Piyiil^uUi P'))- Index 
them yi{v\i,p'), V E s 1, • • • , 2"-^i L For each X2(/c,g'), generate 2"^^ sequences y2 

according to YYi=i Piy2i\x2iik, q')) ■ Index them y2{w\k,q'), w E <1, . . . ^2'^^'^ >. 

5. Randomly partition the set {1, 2, ... , 2"-^!} into 2"'^i cells Sp, p E {1, . . . , 2"-^i}; and 
partition the set {1, ... , 2"^^^} into 2"^2 cells Sg, qE{l,..., 2"^2}. 

The encoding steps are as follows. Basically, node 1 quantizes its received signal from 
the previous block and compresses it. It sends the compressed information together with 
its new signal in the new block. Node 2 does likewise. 

1. In the beginning of block t, remembering its previous transmission in block t — 1, 
xi(j*^^, g*~^); and observing its received signal in block t — 1, yi(t — 1), it finds a 
unique t'*""'^ for which (xi(j*~-^,p*~^), yi(t — l),yi(t'*~-'^|j*~^,p*^^)) G Ae- Using lemma 
2.1.3 in 13, node 1 can find such a v^~^ with probability tending to 1, with a large 
enough n, if 

R^>IiY,;Y,\X,). (8) 

Here, v^"^ is the quantized version of yi(t — 1). 

2. Now, node 1 compresses f*~^ to p*~^. It finds p*~^ for which v^~^ E Spt-i. It then 
sends xi(j*,p*~^) in block t, where j* is the new message from the source. Here, p*~^ 
is to be decoded and used by the destination to estimate f*~^ We see here that node 
1 helps node 2 to send a noisy, quantized, and compressed version of node 2's signal 
to the destination. 

3. In block t, node 2 quantizes y2(t — 1) to w^~^. It can find a unique w*"^ with 
probability tending to 1 if 

R2>nY2;Y2\X2). (9) 

It compresses w^'^ to q^~^, where w^^^ E Sgt-i. It then sends X2(A;*,g*~^) in block t, 
where fc* is the new information. 



The decoding steps are as follows. The destination first decodes the compressed in- 
formation from nodes 1 and 2. It then estimates the quantized information of the nodes. 
Using its received signal and the estimated quantized information, it decodes the messages 
from nodes 1 and 2. 

1. At the end of block t+1, the destination receives y3(t-|-l). It declares (p*, g*) were sent 
by nodes 1 and 2 if it can find a unique pair of (p*, q^) for which (ui(p*), U2(g*), y3(t + 1)) 
G Ae- This can be done with an arbitrarily small error probability if the following 
inequalities hold. 

R[<IiU^■Y,\U2), (10a) 

R'^<IiU2;Ys\Ui), (10b) 

R[ + R'^<I{UuU2;Ys). (10c) 

2. At the end of block t, assume that the destination has correctly decoded (p*~^, q^~^) 
and (p*,g*). It find a set C{t) of {v^,w^) such that 
{yi{v'\j,p'-^),y2{w'\k,q'-^),Uiip'-^),U2iq'~^),y3it)) E A,. 

It declares that {v*,w^) were sent if it can find a unique {v^,w^) G {{v^,w*) : v*' G 
Spt and w* G Sqt} H C-{t). This can be done reliably if 

Ri<I{YrMy2,Ui,U2) + K. (11a) 

/?2</(^2;^3|^i,f/i,f/2) + ^;, (lib) 

R^ + R2 < I{Y^,Y2,Y3\U^,U2) + R!^ + R!2. (He) 

3. At the end of block t, assume that the destination has correctly decoded (f*, w^) and 
^pt-i^^t-i^^ It uses yi(^*|p*~^), y2iw*'\q^~^), and y^if). It declares {j,k) were sent if 

(xi(j*,p*-i),X2(fc*,g*-i),ui(j9*-i),U2(g*-i),yi(t;*|j,p*-^),y2(«;*|A;,g*-i),y3(t))GA. 
This can be done with diminishing error probability if 

i?i</(Xi;y2,1^3|f/i,^2), (12a) 

i?2</(^2;:^l,^3|f/2,Xi), (12b) 

Ri + R2<I{X^.X2;Y^,Y2,Y3\Ui,U2). (12c) 

Combining these rate constraints for the MACF using the compress-forward strategy 
and the constraints for the source coding, ()5a|) - (j3cj) . we get Theorem |21 

4 Conclusion 

In this paper, we have found a new achievable rate region for the MACF and two new 
achievable rate regions for the MACFCS. The former is applicable to cooperative wireless 
communications while the latter is motivated by wireless sensor networks. 
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